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Abstract 



< 

a \ In this paper, we propose oversampling strategies in the Generalized Multiscale Finite Element 

Method (GMsFEM) framework. The GMsFEM, which has been recently introduced in [12], al- 
lows solving multiscale parameter-dependent problems at a reduced computational cost by con- 
^ ■ structing a reduced-order representation of the solution on a coarse grid. The main idea of the 

00 ' method consists of (1) the construction of snapshot space, (2) the construction of the offline space, 

Tj- , and (3) construction of the online space (the latter for parameter-dependent problems). In [11211 . it 



'nI" . was shown that the GMsFEM provides a flexible tool to solve multiscale problems with a com- 

rn ■ plex input space by generating appropriate snapshot, offline, and online spaces. In this paper. 



we develop oversampling techniques to be used in this context (see [19] where oversampling is 
introduced for multiscale finite element methods). It is known (see i\% ) that the oversampling 



^ . can improve the accuracy of multiscale methods. In particular, the oversampling technique uses 

larger regions (larger than the target coarse block) in constructing local basis functions. Our moti- 
vation stems from the analysis presented in this paper which show that when using oversampling 
techniques in the construction of the snapshot space and offline space, GMsFEM will converge 
independent of small scales and high-contrast under certain assumptions. We consider the use 
of multiple eigenvalue problem to improve the convergence and discuss their relation to single 
spectral problems that use oversampled regions. The oversampling procedures proposed in this 
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paper differ from those in [|19ll . In particular, the oversampling domains are partially used in con- 
structing local spectral problems. We present numerical results and compare various oversampling 
techniques in order to complement the proposed technique and analysis. 
Keywords: Generalized multiscale finite element method, oversampling, high-contrast 



1. Introduction 

Heterogeneous media with multiple scales and high-contrast commonly occur in many appli- 
cations, such as porous media and material sciences. The development of reduced-order models 
describing complex processes in such media is needed in such applications. There are a variety 



of multiscale methods, e.g. [|ll.l3L ll6l ll9l-l2lh. that efficiently capture multiscale behavior by con- 



structing a reduced representation of the solution space on a coarse grid. While standard multiscale 
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211]). in this paper we 



methods have proven effective for a variety of applications (see, e.g., [|15- 
consider a more recent framework, GMsFEM, in which the coarse spaces may be systematically 
enriched to converge to the fine grid solution. In particular, we develop oversampling techniques 
within GMsFEM and show that these methods converge independent of the small scales and high 
contrast under certain assumptions. 

The Generalized Multiscale Finite Element Method (GMsFEM) is a flexible framework that 
generalizes the Multiscale Finite Element Method (MsFEM) by systematically enriching the coarse 
spaces and taking into account small scale information and complex input spaces. This approach, 
as in many multiscale model reduction techniques, divides the computation into two stages: offline 
and online. In the offline stage, a small dimensional space is constructed that can be efficiently 
used in the online stage to construct multiscale basis functions. These multiscale basis functions 
can be re-used for any input parameter to solve the problem on a coarse grid. The main idea 
behind the construction of offline and online spaces is the selection of local spectral problems and 



the selection of the snapshot space. In [|12|] . we propose several general strategies. In this paper, 
our focus is on the development of oversampling strategies. 

Oversampling techniques have been developed in the context of multiscale finite element meth- 
ods [|l9n as well as upscaling methods CT. These techniques use the local solutions in larger 



domains to construct multiscale basis functions in the context of MsFEM. We borrow that main 
concept in this paper. In particular, we use the space of snapshots in the oversampled regions by 
constructing a snapshot space spanned by harmonic functions or dominant eigenvectors of a local 
spectral problem formulated in the oversampled domain. Furthermore, we use special local spec- 
tral problems to determine the dominant modes in the space of snapshots. This spectral problem 
is motivated by the analysis and it uses a weighted mass matrix in the oversampled region while 



the energy (stiffness) matrix is constructed in the target coarse domain. By choosing the domi- 
nant modes, we identify multiscale basis functions. These basis functions are then multiplied by 
partition of unity functions to solve the flow equation on a coarse grid (in the absence of the pa- 
rameter). We also describe the use of multiple local spectral problems for enhancing the accuracy 
of the approximation and discuss their relation to single spectral problems that use oversampled 
regions where the latter provides an optimal space. In the presence of the parameter, we also design 
an online space following the same strategy as the offline space construction (but using an online 
parameter value). We employ the Galerkin finite element method, though discontinuous Galerkin 
methods can also be used llioll . 

We present numerical results that demonstrate the convergence of the proposed methods. In our 
numerical experiments, we test two different snapshot spaces that consist of harmonic functions in 
the oversampled region and dominant eigenmodes of a local spectral problem in the oversampled 
region. For the local spectral problems, we also consider various choices by considering mass 
and energy matrices in the oversampled regions. Our numerical results show that the proposed 
methods converge as we increase the dimension of the space and this convergence is consistent with 
our theoretical findings. We also test the use of multiple spectral problems in constructing basis 
functions as well as modifying the conductivity outside the target block to improve the accuracy. 

The paper is organized in the following way. In the next section. Section [2l we present the 
problem setting and the definitions of coarse grids. In Section |3l we present the construction of 
local basis functions. Section |4] is devoted to the numerical results. In Section |5] we present the 
analysis of the method and in Section [6] we offer some concluding remarks. 

2. Preliminaries 

We consider elliptic equations of the form 

— div(fi:(a;;/i) Vm) = / inD, (1) 

where u is prescribed on dD and yU is a parameter. We assume that k{x] jj) = X]g=i Q(/^g)'^g(^) 
and that the coefficient k{x; ■) has multiple scale and high variations (e.g., see Fig.[I]for ki{x) and 
K,2{x) used in simulations). 

To discretize ([B, we next introduce the notion of fine and coarse grids. We let T^ be a usual 
conforming partition of the computational domain D into finite elements (triangles, quadrilater- 
als, tetrahedrals, etc.). We refer to this partition as the coarse grid and assume that each coarse 
subregion is partitioned into a connected union of fine grid blocks. The fine grid partition will be 
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(a) Ki{x) 



(b) K2{x) 



Figure 1: Decomposition of permeability field 

denoted by T^. We use {xi}^^^ (where N.y the number of coarse nodes) to denote the vertices of 
the coarse mesh T^, and define the neighborhood of the node Xi by 



Ui 



|J{K, gT^; x.eKj}. 



(2) 



See Fig. [2l for an illustration of neighborhoods and elements subordinated to the coarse discretiza- 
tion. Furthermore, we introduce a notation for an oversampled region. We denote by tu^ an 
oversampled region of cui C cu^. In general, we will consider oversampled regions co^ defined by 
adding several fine-grid or coarse-grid layers around Ui. 

Next, we briefly outline the global coupling and the role of coarse basis functions for the re- 
spective formulations that we consider. Throughout this paper, we use the continuous Galerkin for- 
mulation, and use coi as the support of basis functions even though co^ will be used in constructing 
multiscale basis functions. For the purpose of this description, we formally denote the basis func- 
tions of the online space Kn by V^^'. The solution will be sought as uh{x; /i) = ^- ^ c*^^^'(a;; /i). 

Once the basis functions are identified, the global coupling is given through the variational 
form 



a{uH, V] /i) = (/, v), for aU v e K^ 



(3) 



and 



Jd 
We note that in the case when the coefficient is independent of the parameter, then Kn = Kff- 



3. Local basis functions 

In this section we describe the offline-online computational procedure, and elaborate on some 
applicable choices for the associated bilinear forms to be used in the coarse space construction. 
Below we offer a general outline for the procedure. 

1. Offline computations: 

- 1 .0. Coarse grid generation. 

- 1.1. Construction of snapshot space that will be used to compute an offline space. 

- 1 .2. Construction of a small dimensional offline space by performing dimension reduc- 
tion in the space of local snapshots. 

2. Online computations: 

- 2.1. For each input parameter, compute multiscale basis functions. 

- 2.2. Solution of a coarse-grid problem for any force term and boundary condition. 

- 2.3. Iterative solvers, if needed. 

In the offline computation, we first construct a snapshot space Fsnap or V^"^^ , depending on the 
choice of domain to generate the snapshot space, where cuf is an oversampled region that contains 
a coarse neighborhood Wj. Construction of the snapshot space involves solving the local problems 
for various choices of input parameters, and we describe the details below. 

3.1. Snapshot space 

3.1.1. Harmonic extensions in oversampled region 

Our first choice of snapshot space consists of harmonic extension of fine-grid functions defined 
on the boundary of ujf. More precisely, for each fine-grid function, 6f{x), which is defined by 
5^{x) = 6i^k, V/, k G Jh{ujf), where Jh{<^t) denotes the fine-grid boundary node on duof . 

For parameter-independent problem, we solve 

subject to boundary condition, ipp^^^"^ = 5^{x) on duof . 

For parameter-dependent one, we can choose several values jij, j = 1, . . . , J (J denotes the 
number of parameters used) to generate the snapshot space separately as above and combine them 
to obtain the snapshot space (see details in Section |431) . 
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Figure 2: Illustration of a coarse neighborhood and oversampled domain 



3.1.2. Local spectral basis in oversampled region 

We propose to solve the following zero Neumann eigenvalue problem on an oversampled do- 
main cut'- 



A+(/i,)^, 



i,j 



,snap 



xtrsHi^.w, 



-jSnap • + 



(4) 



where fij (j = 1, . . . , J) is a specified set of fixed parameter values, and we emphasize that the 
superscript + signifies that the eigenvalue problem is solved in an oversampled coarse subdomain 



w,- 



'. The matrices in Eq. dU are defined as 



A^{lJ,j) = [a'^{j2j)rr^n]= k{x] ^j)V (pn^ <Pm and S'^ (jJj) = [s^ {j2j)mn] = 



k{x; Hj)(f)n4>m, 

(5) 



where 0„ denotes the standard bilinear, fine-scale basis functions and the form for k will be dis- 
cussed in Section [51 In our numerical implementations, we take k = k, though one can use 



multiscale basis functions, xt in ujf, to construct k as k = J2i '^l^xtl'^ (see [|l3L ll8|] for more 
discussions on the choice of partition of unity functions). We note that Eq. & is the discretized 
form of the continuous equation 



-div(fi;(x; fij)V^IJij P) = Xij ^k{x; fij)^ljij 



-.snap 



m u. 



After solving Eq. Q, we keep the first Lj eigenf unctions corresponding to the dominant eigen- 



values (asymptotically vanishing in this case) to form the space 

K+p = span{^+;^"^P : 1 < j < J and 1 < / < L,}, 

for each oversampled coarse neighborhood co^. We note that in the case when cui is adjacent to 
the global boundary, no oversampled domain is used. For the sake of simplicity, throughout, we 



,snap 

i 
We reorder the snapshot functions using a single index to create the matrices 



denote continuous and discrete solutions by the same symbol (e.g., V'z ,'™^'' i^i the above case). 



-^snap 



Vl ) • • • ) ^Msnap ^^^ -^™ap — Wl I- ■ ■ ■,Wl 



where ip^^^ denotes the restriction of ^J'™^'' to Ui, and Msnap denotes the total number of functions 
to keep in the snapshot matrix construction. 

Note that the above process to generate local spectral basis is also applied to parameter- 
independent problems. 

3.2. Offline space 

We will discuss two types of offline spaces where the first one will use one spectral problem 
in the snapshot space and the other one will use multiple spectral problems in the snapshot space 
(following Theorem 3.3 of [|4|]). 

3.2.1. Offline space using a single spectral problem 

In order to construct an oversampled offline space V^ or standard neighborhood offline space 
Von, we perform a dimension reduction in the space of snapshots using an auxiliary spectral de- 
composition. The main objective is to use the offline space to efficiently (and accurately) construct 
a set of multiscale basis functions for each ji value in the online stage. More precisely, we seek a 
subspace of the snapshot space such that it can approximate any element of the snapshot space in 
the appropriate sense defined via auxiliary bilinear forms. At the offline stage the bilinear forms 
are chosen to be parameter-independent, such that there is no need to reconstruct the offline space 
for each /i value. We will consider the following eigenvalue problems in the space of snapshots: 
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/l+,off^off \off /loff,TrOff 
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^off^off _ Af 5+'°^^f 
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^+,oft\r;off ^ ^^offQ+,off^off 
fe k k 



(6) 
(7) 
(8) 
(9) 
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coff _ r„off 
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The coefficients k{x,ii) and 'K{x,ii) are parameter-averaged coefficients (see [|l2ll ). Again, we 
will take k(x, u) = k(x, //) though one can use multiscale partition of unity functions to compute 
k(x, /i) (cf. 11130). We note that A and A denote analogous fine scale matrices as defined in 
Eq. dH), except that parameter-averaged coefficients are used in the construction, and that A is 
constructed by integrating only on cuj. To generate the offline space we then choose the smallest 
Moff eigenvalues from one of Eqs. ©-dSj and form the corresponding eigenvectors in the respective 
space of snapshots by setting i^p"'' = J2j ^gV^/'"'' or ^f = J2j ^gV^r' (for fc = 1, • • • , Moff), 
where \Ef^* are the coordinates of the vector '^^. We then create the offline matrices 



K 



■off 



4^r 



off 



'^m' 



off 



and i?off= [<,..., <J 



to be used in the online space construction. 



Remark 1. At this stage, we note that in the case when we have a parameter-independent coeffi- 
cient in Eq. ([T]), many of the expressions in this section are simplified. In particular, there is no need 



for averaging the coefficients in order to create the respective (offline) mass and (offline) stiffness 
matrices. Furthermore, the offline space represents the final space in which the enriched multiscale 
solutions will be computed. Thus, the discussion of online space creation below is limited to the 
case when the problem is parameter-dependent. 

Remark 2. Our analysis in Section\5\shows that the convergence of the GMsFEM is proportional 
to the reciprocal of the eigenvalue that the corresponding eigenvector is not included in the coarse 
space. We have compared the decay of the reciprocal of eigenvalues for Eg. Q, Eg. ([7]), and 
Eg. ([8]) (by choosing a subdomain for k{x) in Fig. Hj). We plot the decay of the eigenvalues for a 
coarse block in Fig. \3\ (note logarithmic y-scale). As we observe from this figure that the decay 
of eigenvalues corresponding to Eg. ^ (when oversampling is used in formulating the eigenvalue 
problem) is faster compared to Eg. ^ (when no oversampling is used). 

3.2.2. Offline space using multiple spectral problems 

Motivated by Theorem 3.3 of [|4|], we propose an offline space that uses both Eq. Q and Eq. ^. 
In particular, using dominant eigenvectors of both Eq. (|6]) and Eq. Q, we take a union of these 
eigenvectors to construct an offline space. In particular, as described above, we use tpp" = 
E, ^tf'i^P'"^ (for A; = 1, ... , M+,off) or ^f = E, ^^C' (for A: = 1, ... , M,^), where <iltf 
are the coordinates of the vector ^^^ in Eq. dH) and "^^ are the coordinates of the vector "^^ in 
Eq. ^. Then, the offline space is constructed as a union of ifj^^ and ip'^'" after eliminating linearly 
dependent vectors. We present an analysis in Section Isl and numerical results in Section 14.1.1 1 

3. 3. Online space for parameter-dependent case 

We only describe the online space using a single spectral problem. One can analogously con- 
struct the online space using multiple spectral problems. For the parameter-dependent case, we 
next construct the associated online coarse space Kn(yLt) for each fixed fi value on each coarse 
subdomain. In principle, we want this to be a small dimensional subspace of the offline space for 
computational efficiency. The online coarse space will be used within the finite element framework 
to solve the original global problem, where a continuous Galerkin coupling of the multiscale basis 
functions is used to compute the global solution. In particular, we seek a subspace of the respective 
offline space such that it can approximate any element of the offline space in an appropriate sense. 
We note that at the online stage, the bilinear forms are chosen to be parameter-dependent. Similar 
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analysis motivates the following eigenvalue problems posed in the offline space: 

A'\f,)^T = Ar^°"(/i)^r (10) 

or 

A+'°"(/x)vi/™ = ArA°"(/x)^r (11) 

or 

A™(/i)*r = Ar^+'°"(/i)*r (12) 



where 



A°"(/x) = [a™(/x)^„] = f Kix; /i) VC " V^'' = i?^ffA(/i)i?off, 

Juli 



5°"(/x) = [s"\fiUn] = I li{x-fi)r^^f = i?Sf^(/i)/2, 



off, 



^-^'^i/^) = [^;^r(/^)] = / ^(^,/^)^;!;'°''^n^'°' = «ff)'"5+(/.)i?+f, 

and /i;(x; /i) and ^{x; /i) are now parameter dependent. Again, we will take k{x, /i) = k{x, jj) 
in our simulations though one can use multiscale partition of unity functions to compute k(x, jj) 
(cf. UlSi]). To generate the online space we then choose the smallest A/on eigenvalues from one 
of Eqs. (fT0l)-(fT2l) and form the corresponding eigenvectors in the offline space by setting ^™ = 
Y,j ^Tji^f (for /c = 1, . . . , Mon), where ^^" are the coordinates of the vector ^^". 

4. Numerical Examples 

4.1. Parameter-independent case 

First, we consider parameter- independent case 

i<i{x] /i) = k(x) 

by choosing iMjM2 = 0.5 (see Fig. |4]for an illustration of the resulting permeability). In previous 



works, e.g., lll3ll . k takes the general form k = K^^H'^\\/Xi\'^, where x-i denotes an original 



partition of unity [|l2ll . although we take k = k for the majority of examples in this section. The 



fine-grid is chosen to be 100 x 100. We consider two coarse grids, 10 x 10 and 20 x 20. The error 



11 




x10 

9 
8 
7 
6 
5 
4 



0.2 0.4 0.6 0.8 



Figure 4: Permeability field used in Section |4TT] 



will be measured in weighted L^ and weighted H^ norms defined as 
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Then Eq. ([T]) is solved with / = 1 and linear Dirichlet boundary condition. 

In the first set of numerical examples, 10 x 10 coarse grid and the oversampling region of the 
size of 10 fine-grid blocks in each direction is chosen (i.e., the oversampled region contains an 
extra coarse block layer around cui). We denote this oversampled region by co^ = 3 x cui. We use 
the eigenvalue problems Eq. ^, Eq. (|7]), and Eq. ([8]) in the space of snapshots generated in the 
oversampled region by harmonic extensions as in Subsection 13. 1.11 In all numerical cases, we take 
K = K. In Tables [Tl|2l and[3l we present the errors for weighted L^ norm and weighted H^ norm. 
As we observe that all cases predict similar convergence errors that decrease as we increase the 
dimension of the space. We note that in this case there is a residual error because of the fact that 
we use harmonic functions as a space of snapshots and thus we can not approximate the error due 
to the source term. This error for 10 x 10 coarse mesh is about 10% (or order of coarse mesh size). 
Because of this irreducible error, the convergence of GMsFEM deteriorates and remains at 10%. 

In the next example, we consider a smaller oversampled region that includes only one fine grid 
block. We denote this by cul' = cui + 1. We have tested various oversampled region sizes and 
include only one representative example. In this example (see results in Table |4] ), we observe 
similar error behavior as those in previous examples. 

As we discussed earlier, the error between the fine scale solution and GMsFEM solution con- 
tains an irreducible error because of the fact that the harmonic snapshots are used and these snap- 
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dim(Kff) 


A, 


\u-u°^\ (%) 


LUD) 


H'AD) 


364 


1.04x103 


0.46 


17.26 


526 


2.62x10^ 


0.42 


13.84 


688 


4.29x10^ 


0.33 


11.92 


909 


1.15x10^ 


0.30 


10.90 



Table 1: Relative errors between the fine scale solution and offline spaces; Eigenvalue problem from Eq. (|6]l, 10x10 
coarse mesh, harmonic snapshots, cj^^ = 3 x cj^. 



dim(v;i) 


A, 


1 u - n+'°« 1 (%) 


LUD) 


mD) 


364 


33.16 


4.22 


33.69 


526 


105.32 


0.65 


16.59 


688 


669.50 


0.32 


11.95 


909 


8.12x10^ 


0.30 


10.82 



Table 2: Relative errors between the fine scale solution and offline spaces; Eigenvalue problem from Eq. (|7]i, 10x10 
coarse mesh, harmonic snapshots, ujf' = 3 x w^. 

shots can not approximate the effects of the right hand side. This error can be easily estimated for 
high-contrast problems considered in this paper and it is of order 0{H). First, we consider the 
use of dominant eigenvectors as a space of snapshots that correspond to smallest eigenvalues of 
Eq. © in Lo^ = 3 X cui as a snapshot space. In this snapshot space, we apply Eq. dS]) and identify 
dominant modes in the target domain as before. The numerical results are presented in Table |5] 
As we observe from these results that the error is smaller when eigenvector snapshots are used. In 
general, when comparing to the fine-scale solution, one can also use fewer modes corresponding to 
the space of harmonic snapshots and some extra modes that represent source term within the local 
domain (e.g., modes that correspond to homogeneous Dirichlet eigenvalue problem). In Tabled 
we present numerical results, where the GMsFEM solution is compared to the solution computed 
in the space of harmonic snapshots. In this setup, there is no irreducible error and the method 



dim(Ki) 


A, 


|m-m+'°**| (%) 


LUD) 


H^iD) 


364 


2.11x10^^ 


4.47 


45.99 


526 


8.62x10-^ 


1.62 


27.65 


688 


0.0018 


0.28 


14.54 


909 


0.0093 


0.30 


11.09 



Table 3: Relative errors between the fine scale solution and offline spaces; Eigenvalue problem from Eq. dSJ, 10x10 
coarse mesh, harmonic snapshots, uj^ = 3 x Wi. 
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dim(V;+) 


A, 


1 U - M+'°'*|| (%) 


Di{D) 


H'AD) 


526 


0.03 


1.64 


25.51 


850 


0.08 


0.38 


14.82 


2470 


533.50 


0.31 


12.10 


3280 


1.08x103 


0.30 


11.42 



Table 4; Relative errors between the fine scale solution and offline spaces; Eigenvalue problem from Eq. dHJ, 10x10 
coarse mesh, harmonic snapshots, lo'I = cj; + 1. 

converges to the fine scale solution. Moreover, we notice that the errors are smaller. 



dim(K^) 


A* 


1 u - n+'°« 1 (%) 


Di{D) 


H'AD) 


364 


0.0045 


0.27 


17.49 


688 


0.055 


0.08 


9.88 


1012 


0.91 


0.07 


7.33 


1660 


37.3 


0.03 


4.04 


3280 


1.68x10^ 


0.004 


1.10 



Table 5: Relative errors between the fine scale solution and offline spaces; Eigenvalue problem from Eq. (|8]l, 10x10 
coarse mesh, eigenvalue snapshots, ujf =3 x Wi. 



dim(K^) 


A, 


^+,yU9_^+,ott| (%) 


^i{D) 


H'AD) 


364 


2.11x10"^ 


4.69 


44.36 


526 


8.62x10"^ 


1.75 


25.17 


688 


0.0018 


0.16 


9.34 


860 


0.0070 


0.05 


3.85 



Table 6: Relative errors between the maximal dimension offline solution (u+'^*'^) and offline spaces obtained from 
using oversampled domains; Eigenvalue problem from Eq. (|8), 10 x 10 coarse mesh, harmonic snapshots, uj'l ~ ixuii. 

For the next set of numerical examples, we use 20 x 20 coarse-grid. In Table |7l we present 
numerical results when the eigenvalue problem Eq. (|8) is used. As in the case of 10 x 10 coarse 
grid, there is an irreducible error; however, it is lower (about 5%), because of the coarse mesh 
size. To remove the irreducible error, we compare the GMsFEM solution to the solution computed 
with snapshot vectors in Table [8] As we observe that the error is smaller and it will converge to 
zero as we increase the dimension of the coarse space. We also present an error when a different 
oversampling domain size is used in Table |9] The results are not sensitive to the oversampling 
domain size as these results show. In Table [TOl we present relative errors when the snapshot space 
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is chosen to consist of eigenvectors as defined in Eq.|4](cf. Table[51). In this case, similar to Table 
[51 we observe smaller errors when the snapshot space consists of eigenvectors in Eq. |4] We also 
present a numerical result in Table [TTI where the coefficients in uj^\cOi reduced by le+4 to diminish 
the constant in the estimates presented in Section ISTTl 



dim(K^) 


A* 


\u-u+'°^\ (%) 


LiiD) 


mm 


1524 


3.25x10-5 


2.69 


36.37 


2168 


1.70x10-^ 


0.65 


18.42 


2705 


4.71x10"^ 


0.21 


11.04 


3471 


0.014 


0.07 


5.03 



Table 7: Relative errors between the fine scale solution and offline spaces obtained from using oversampled domains; 
Eigenvalue problem from Eq. (|8), 20 x 20 coarse mesh, harmonic snapshots. 



,+ - 



3 X uj.i 



dim(K^.) 


A* 


||^+,3471 _ ^+,ott|| (%) 


LUD) 


mm 


1524 


3.25x10-5 


2.72 


35.98 


2168 


1.70x10"^ 


0.69 


17.70 


2705 


4.71x10-^ 


0.22 


9.82 


3182 


0.0059 


0.02 


3.21 



Table 8: Relative errors between the maximal dimension offline solution (u^'^*'^) and offline spaces obtained from 
using oversampled domains; Eigenvalue problem from Eq. (|8), 20 x 20 coarse mesh, harmonic snapshots, w^ = 3 x Wi. 



dim(Kff) 


A, 


\\u-u°^\ (%) 


mm 


mm 


1524 


0.03 


0.27 


19.47 


2607 


0.06 


0.15 


12.39 


3690 


0.16 


0.07 


9.40 


7300 


684.14 


0.05 


3.70 



Table 9: Relative errors between the fine scale solution and offline spaces obtained from using oversampled domains; 
Eigenvalue problem from Eq. (|8), 20x20 coarse mesh, harmonic snapshots, cj^ = cji + 1. 



Finally, we plot the energy error against (1/A^,) 2 for 10 x 10 and 20 x 20 cases in Figs. [51 The 
correlation between the errors and 1/A^. is over 0.93 when we consider 10 x 10 mesh case (as in 
Figs. |5(a)[ and |5(c)| ). Li Figs. |5(b)| and [5(d)l we depict the relative errors corresponding to Tables [8l 
and[IOl In this case, we also observe a good agreement and the correlation to be over 0.98. 
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dim(V;+) 


A, 


1 U - M+'°'*|| (%) 


Di{D) 


H'AD) 


1524 


0.002 


1.25 


28.54 


2102 


0.009 


0.22 


14.34 


2607 


0.014 


0.12 


8.25 


3596 


1.03x10^ 


0.01 


2.06 



Table 10: Relative errors between the fine scale solution and offline spaces obtained from using oversampled domains; 
Eigenvalue problem from Eq. (|8), 20x20 coarse mesh, eigenvalue snapshots, uj'l =3 x cj^. 



dim(K^) 


A, 


||n-n+'°"|| (%) 


Di{D) 


mD) 


1524 


0.23 


0.75 


21.01 


2168 


0.82 


0.18 


13.19 


2705 


2.45 


0.08 


8.67 


3471 


117.18 


0.07 


4.44 



Table 1 1 : Relative errors between the fine scale solution and offline spaces obtained from using oversampled domains 
with n ~ j^ in uofXiOi, Eigenvalue problem from Eq. (|8), 20x20 coarse mesh, harmonic snapshots, Lof = 3 x w^. 



4.1.1. Parameter-independent case using multiple spectral problems 

In this section, we study the use of multiple spectral problems as described in Section I3.2.2I In 
particular, we use only two spectral problems in u and u^ . The results are presented in Tables [12 
anddSl As the convergence theory indicates, for the same eigenvalue threshold, one can expect the 
quadratic decay in the convergence rate with a constant that is described in Section 15.21 In Table 
fT2l we compare the offline solution and the fine grid solution, while in Table [131 we compare 
the offline solution and the snapshot solution. In both cases, we observe that the square of the 
error resulting from a single spectral problem correlates well to the case corresponding to multiple 
spectral problems. This behavior deteriorates when the space dimension is large due to irreducible 
error. For this set of numerical results, we observe that the coarse space dimension resulting 
from multiple spectral problems is large compared to the case when a single spectral problem is 
used. However, we note that our convergence result does not contain any information about the 
dimension of the coarse space, but only about an eigenvalue threshold. On the other hand, our 
convergence analysis suggests that the coarse space needs to include an approximation in both uj 
and uj^ . The eigenvectors of Eq. ([9]) may be represented using the eigenvectors of Eq. (|6]), and thus 
one can use the respective eigenvectors to complement each other. Our numerical results show that 
by combining eigenvectors of Eq. ^ and Eq. dD, one can achieve better convergence compared to 
only using Eq. Q in our pre- asymptotic numerical simulations. 
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30 40 50 

(l/A*)i/2 
(a) TV = 10, corrcoef=0.' 




20 40 60 80 100 120 140 160 180 

(1/A*)V2 
(b) N = 20, corrcoef=0.99 
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H 0.2 


^^ 




Energy 


^^ 




0.05 


^y^ 




-^ 




0.0 










5 10 16 


20 2 




(1/A*)V= 





l/A-)l/2 



(c) A^ = 10, corrcoef=0.93, eigenvalue snaps (d) N = 20, corrcoef=0.97, eigenvalue snaps 

Figure 5: Relation between relative energy error and A* for Tables l6l l8l |5] and [TOlrespectivelv. 

4.2. Parameter-dependent case 

For the next set of numerical results, we consider a parameter-dependent example where 

where ki(x) and K2{x) are depicted in Fig.[T] For the numerical examples, we consider a snapshot 

3 X CO,: for 



UJ, 



space that consists of solving local eigenvalue problem described by Eq. Q in 
9 selected values of yU = (yUi, /i2). By choosing 20 dominant eigenvectors for each of 9 selected 
values of /i and ensuring linear independence, we form the space of snapshots. In this space of 
snapshots, we use the operator averaged over /i to construct the offline space. In particular, we 
consider 3 choices for offline eigenvalue problems that are given by Eq. Q, Eq. (|7]), and Eq. ([8]). 
These local eigenvalue problems are used to construct the offline space. Furthermore, we use the 
same eigenvalue problems for an online value of the parameter, to construct an online space which 
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dim(Kff) 


A* 


Hl(D)(%)(Eqs.e, ©) 


Hl{D) (%) (Eq. ^) 


791(618) 


60.52(147.82) (tol = 60(100)) 


31.47 


38.34 


1172(733) 


401.56(1.01x10^) (tol = 400(1000)) 


14.72 


24.42 


2054(1568) 


1.00(5.05) X 10^ (tol = 1000(5000)) 


8.28 


10.73 



Table 12: Relative errors between the fine scale solution and offline spaces for local spectral problems using a single 
(Eq. (|6]l) and multiple eigenvalue problems (Eq. (|9]l and (|6]l). 20x20 coarse mesh, harmonic snapshots, w^ = 3 x uji. 



dim(Kff) 


A* 


Hl(D) (9o) (Eqs. ^, ^) 


Hl{D) (%) (Eq. ^) 


791(618) 


60.52(147.82) (tol = 60(100)) 


31.26 


38.16 


1172(733) 


401.56(1.01x10^) (tol = 400(1000)) 


14.31 


24.16 


2054(1568) 


1.00(5.05) xlO^ (tol = 1000(5000)) 


7.53 


10.16 



Table 13: Relative errors between the snapshot solution and offline spaces for local spectral problems using a single 
(Eq. (|6]l) and multiple eigenvalue problems (Eq. (|9|l and (|6]l). 20x20 coarse mesh, harmonic snapshots, ujf' = 3 x uti. 



is a subspace of the offline space by solving the local eigenvalue problem Eq. (fTOl ). Eq. (ITTI) . and 
Eq. (fT2l) . The results are presented in Tables [14] [151 [Ml respectively. We see from these results 
that the GMsFEM converges in all the cases considered above. The best convergence among the 
three choices it found in Table \T6\ 



dim(Kn) 


A, 


1 n - u™ 1 (%) 


1 n°" - n°«|| (%) 


L'iiD) 


h:.{d) 


L'iiD) 


h:.{d) 


728 


537.1 


0.26 


11.20 


0.18 


9.50 


907 


1.05x10^ 


0.18 


8.62 


0.09 


6.27 


1037 


1.93 xlO^ 


0.17 


8.22 


0.09 


5.72 


1248 


3.22x10^ 


0.11 


6.42 


0.02 


2.55 


1378 




0.10 


5.89 


0.00 


0.00 



Table 14: Relative errors between the fine scale solution (and offline) and online spaces obtained from using non- 



oversampled domains; Eigenvalue problem from Eq. (ITOt . 10x10 coarse mesh, eigenvalue snapshots, i 



3 X uji 



5. Convergence studies and discussions. Parameter-independent case 

5.1. Offline space using a single spectral problem 

We define J'^'m and I"^^ u as an interpolation of u in Wj and uf that will be chosen. Because 
the snapshot functions are defined in ujf, I'^'u = I'^i uinuji. We have 



-div(/€(a;)V(u - /'^'n)) = g'm Ui, 
— div(K(x)V(u — I'^' u)) = g in ujf, 



(13) 
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dim(0 


A* 


|n-n+'™| (%) 


1 ^+,on _ ^+,ott| (<7^) 


Di{D) 


H'AD) 


Di{D) 


H'AD) 


826 


11.47 


0.27 


10.93 


0.18 


9.19 


988 


40.84 


0.17 


8.37 


0.09 


5.93 


1133 


65.10 


0.10 


6.23 


0.01 


2.02 


1280 


350.0 


0.10 


6.03 


0.007 


1.27 


1378 




0.10 


5.89 


0.00 


0.00 



Table 15: Relative errors between the fine scale (and offline) solution and online spaces obtained from using oversam- 
pled domains; Eigenvalue problem from Eq. (fTTT i. 10 x 10 coarse mesh, eigenvalue snapshots, uf = 3 x w^. 



dim(Kt) 


A* 


M-M+'°" (%) 


^+,on_^+,ott (%) 


Di{D) 


Hl.{D) 


Di{D) 


Hl.{D) 


790 


4.33x10-^ 


0.22 


10.37 


0.25 


8.51 


888 


0.0032 


0.09 


7.90 


0.06 


5.25 


1133 


3.27 


0.10 


6.29 


0.03 


2.18 


1280 


154.3 


0.10 


5.96 


0.004 


0.87 


1378 




0.10 


5.89 


0.00 


0.00 



Table 16: Relative errors between the fine scale (and offline) solution and online spaces obtained from using oversam- 
pled domains; Eigenvalue problem from Eq. (fT2] i. 10 x 10 coarse mesh, eigenvalue snapshots, w^ = 3 x w^. 



where g is the source term, g = f + div(K(x)V/'^'n). Furthermore, we define Xi ^^id xt ^^ 
partition of unity functions subordinated to cui and cu^. In particular, we can assume that Xi and xt 
are standard bilinear partition of unity functions for a rectangular partition. In general, we do not 
require xt to be a partition of unity function; however, we require xt to be zero on dut and 

ivx.r ^ ivx+r. 

This is satisfied for bilinear functions. 

Multiplying both sides of (fT3l) by xli^ — I^^u) (or (x^)^(m — /'^^ u) for the equation in uf), 
integrating by parts and re-arranging the terms, we have 



< ^ I ^^\Vx^Wu-r^u)\' + c I nx^^\v{u-r^u)\' + \ I gxl{u-r^u) 
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where C < 1 is independent of contrast. From here, we get 

f Kxj\Viu-I-^u)\'^ f «:|Vx.n(n-/-^n)|2 + | / gx^{u - I'^^u)]. (14) 

Similarly, 

I K\xt?\V{u-rtu)\^^ I n\VxtWu-rtu)\^ + \l g\xt\\u-rtu)\. (15) 

Ju}+ Juj+ Jujf 

Next, taking into account that MsFEM solution, uh, provides a minimal energy error, we have 

f k\V{u-Uh)? ^ [ K\V{y2x^iu-I-^u))\' 

Jd Jd ■ 

^ H I '^|Vxi|V-/"'M|' + ^ / K\xi\''\V{u-r^u)\\ (16) 

Combining this inequality with (fT4l) . we obtain, 

f k\V{u-uh)? ^ J]/ «:|Vx.ri« -/"'«!'+ (5^/ 

+ El I 9\x^\\u-r^u)\\ (17) 

i ^'^^ J 

Next, we concentrate in deriving a bound for the first term on the right hand side of the last in- 
equality above. 

Note that I'^-' u = I'^'u in cui. Next, we define the interpolant I'^^ u using the modes for the 
eigenvalue problem Eq. (|7]) that correspond to the eigenvalues Af % ■ " " ) -^l- Then, we have 

/ n\wxt\\u-rtuf<-^ f K\v{u-r^u)\\ (18) 

Jaj+ ^Li + l Ji^r 

which is easily deduced from the corresponding eigenvalue problem and the definition of the in- 



K\x^V\V{u-r^u) 



20 



terpolation I^^u, we have 



(19) 
Note also that we can bound the last term above by 



A* 



^ x: (e /, «^i vx.+i> - i^'^^i' + E I /, 9\xmu - rtu) \ 

\ i i i i J 

X-AT.^1 ^Mu-I^'u)\' + Y,\l^9\xmu-I''^u)\\, (bydH) 
where we have defined A=, = min^. A^'^^. Thus, summarizing the last set of inequalities we obtain, 

Applying this inequality n times in the estimate for J2i X; '^I^XiPl^ ~ /"^'Mp in Eq. (fT9l) . we 
get 

E / '^IVx.+n^-^^^'^l'^E v^ / ^Mu-r'u)\' 

-- (^)"i:£3^«iv("-/-)p.i:(i:)'i:i/,«ixriv-K.)i 

^ (i)""E£^|v(-/"-)i^.(A.r(ie^)i:i.(i'^iivx.^P)-y. 

Considering ^. /^ fi;|V(M — /'^'m)P ^ Jp fi:|VMp, we have the following convergence rate for 
GMsFEM, 

^ n\V{u -uh)\'^^J^ n\Vu\' + ((A.)" (^x^) + ^' ^^^^ 
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where R = J2il +{\f^\\^xt\'^) ^9^- ^^^ right hand sides with (^ ^ 1 it can be shown that 
With this assumption, we have the convergence resuh, 



L 



^M^-^H)f^^l^^\Vuf+(^iAr[^j^^ (21) 

Choosing A^, sufficiently large (larger than 1) and n = 1 — ^"^^ (in each cuj), we obtain 

f k\V{u - uh)\^ ^ (^\ f k\Vu\' + ^. (22) 

Collecting the resuks above, we have 
Theorem 3. IfA^ > 1 and Jj^ K,~^g^ :< 1, then 



k\V{u-uhW ^ ( ^] / k\Vu\'^ + —. 



|2 



D 



\A.*/ J £) A^ 



Next, we comment on the estimate on g. We consider the snapshot space generated by Eq. (H). 
Because |Vxi^P ^ H~^, we have R :< H^ f + K~^g^. We assume that I'^' u = J2i=i Q^^ where 
\I// are eigenvectors Eq. ([8]). Each eigenvector \I/; is spanned by eigenvectors of Eq. dU, i.e., ^^ = 
dim^+. Then, g = f + div(«:(x) V/-'n) = / - J^^ZT Ezti QrfzmA^«:^+ = f-Em d*m>^m^4^i, 
where (i^ l = ^i=i (^idim, ^m are eigenvalues in Eq. dH), Mjnap is the number of snapshots, and L 
is the number of modes selected in the offline stage. Due to orthogonality of ^+, it can be shown 
that j^+ K-^g^ ^ 1 + T.m{d*m,Ly^m.' providcd 1 ^ k. On the other hand, J^+ k\VP 

EmidL,L?Xm. Thus, 



' U 



2 



5.2. Offline space using multiple spectral problems and the relation to oversampled spectral prob- 
lems 

In this subsection we briefly consider the convergence analysis for the offline space proposed 
in Section [3.2.21 For this analysis we use the harmonic snapshot space to avoid any residual error, 
though the derivation can be extended to other scenarios. This derivation uses the proof of Theorem 
3.3 from the work of Babuska and Lipton ^ and we extend it to a high-contrast case. We start with 
the inequality in Eq. (fTTI) . We define two interpolants I"^* u and J'^'m by choosing the dominant 
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modes through considering 

/ K\Vxt\\u-I^tuf^^— [ K|V(n-Ku)|2^^— / K|Vup (23) 

/ ^\Vxi\\n-r'u)' ^ -J— [ k|V(S- J"»72)p ^ -^ /" k\Vu\', (24) 

where u = u — I'^^ u, — I— and ^ — are sufficiently small. We choose the interpolant to be 

^Li + l 

I'^^u + I'^'u. Thus, u - {I'^^u + I'^'u) =u- I'^'u. Then, we have 

where A^, = min^^. A'^',_^j^ and A+ = min^. A^'._,_^. Thus, choosing A* and A+ to be sufficiently 
large, the convergence rate can be improved. In particular, the final estimates involve the product 
of the convergence rates with individual spaces. 

The above results can be summarized in the following way. If Eq. (|23l) and Eq. (|24)) can be 
satisfied by choosing appropriate interpolants in cu and a;+, then 



D ^^* ^^* J D 



This result can easily be extended to use multiple eigenvalue problems (instead of two eigenvalue 
problems). 

Remark 4. In the above proof, we rely on the estimates that bound the L\-norm via the H\-norm 
in uj and u^. In addition, we use an inequality that bounds Hl{uj) by L^(u;"*") norms based on 
PDE estimates. The latter can be replaced by a third eigenvalue problem, A~^'"-ff'^'f = XfS"^'^'f, 
(cf. Eq. ©j, and one can select its important modes (corresponding to largest eigenvalues) to 
reduce the constant relating Hj.{u!) to L'^{uj~^) norms. We have implemented this procedure and 
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observed a slight improvement, at the cost of additional basis functions (similar to the numerical 
results presented in Section \4.1.1\) . 

Next, we discuss the relation of using multiple spectral problems to the eigenvalue problems 
discussed earlier. Because of the optimality of local spectral spaces (cf. [|4|] and see below), we 
know that the spectral problems that are similar to those described by Eqs. (|7]) and dS]) will provide 
a better convergence rate compared to those using multiple spectral problems. For the two spectral 
problems described above, one can equivalently use (cf. Eqs. ([7]) and ([8])) the following local 
spectral problem 

^+,off^off ^ ^off^off^off (26) 



for construction of the offline spaces. Indeed, if Eq. (1261 1 is used, we can show that (cf. Eq. (1251) ) 

where A^, = min^. A'J^'_,_j^. On the other hand, the local spectral problem Eq. (|26] ) provides an 
optimal subspace in the following sense. For a fixed Li dimensional subspace in cjj, a space that 
provides the smallest 

max mm 

M «o (u — Uoj ^"'"' (m — Mo) 

is given by the the span of the smallest (in terms of corresponding eigenvalues) Lj eigenvectors of 
Eq. (|26|) (see also [|4|] for more general discussions), or by the largest (in terms of corresponding 
eigenvalues) U eigenvectors of 5"+'°^*^^ = (Af ') "^ A^^'^f. Consequently, the use of Eq. ^^ 
in constructing local spaces will give a better approximation compared to using multiple spectral 
problems that provides a rate which is the product of fl 1/A* j, where j represents the correspond- 
ing eigenvalue for j-th eigenvalue problem. Consequently, if we set a threshold for the eigenvalue 
for each problem as A*, then the convergence rate is (1/A^,)", where n is the number of eigenvalue 
problems are used. Note also that, each used eigenvalue problem will increase the dimension of the 
final reduced space. In general, one can show similar results for eigenvalue problems considered 
earlier, as in Eqs. (|7]) and (|8]). 

We present numerical results corresponding to the use of the eigenvalue problem in Eq. (|26|) in 
Table [TtI If we compare these results to Table |7l we observe that the convergence of the method is 
better than if the eigenvalue problem of Eq. ([8]) is used. 
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dim(V;+) 


A* 


1 U - M+'°'*|| (%) 


Di{D) 


H'AD) 


1163 


3.01x103 


3.11 


34.53 


1524 


5.35x10^ 


0.25 


13.64 


1885 


7.51x103 


0.20 


8.69 


2607 


7.76 xlO^ 


0.12 


5.91 



Table 17: Relative errors between the fine scale solution and offline spaces obtained from using oversampled domains; 
Eigenvalue problem from Eq. (l26t . 20x20 coarse mesh, harmonic snapshots, cj,^ = 3 x LOi. 



6. Conclusions 

In this paper, we develop and investigate oversampling strategies for GMsFEM. The GMsFEM 
offers a flexible framework for solving multiscale problems by constructing a reduced dimensional 
approximation for the solution space. In particular, GMsFEM constructs a local approximation 
space via appropriate local spectral problems. We show that the use of oversampling strategies can 
yield a convergence independent of the contrast and the small scales under certain assumptions. 
The proof relies on the fact that the local spectral problems that are used for basis construction 
involve oversampled regions. The convergence of GMsFEM is proportional to the maximum of 
the inverse of the eigenvalue such that the corresponding eigenvector is not included in the coarse 
space. Our numerical results show that the reciprocal of the eigenvalues decay faster when over- 
sampling is used (in particular, for the local spectral problem that is proposed in the paper). We 
present some representative numerical results where various oversampling strategies are studied. 
Our results compare the fine grid solution with GMsFEM solution as well as the solution computed 
in the snapshot space with GMsFEM solution. We study the use of multiple spectral problems for 
enhanced accuracy and discuss their relation to single spectral problems that use oversampled re- 
gions where the latter provides an optimal space. Both convergence analysis and numerical studies 
are presented. Numerical results show that the proposed oversampling techniques are efficient and 
have similar errors. We also present numerical results for parameter-dependent problems using our 
proposed strategies. The numerical results for each configuration are discussed in the paper. 
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